Papers with Text Summarization
ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generation (2022.naacl-srw)
Copied to clipboard
| Challenge: | Existing models for the English language have been used to train on large corpus of high-quality texts. |
| Approach: | They present a pretrained Transformer-based encoder-decoder model for the Vietnamese language . they benchmark ViT5 on two downstream text generation tasks . |
| Outcome: | The proposed model outperforms existing models on Vietnamese Abstractive Summarization and Named Entity Recognition tasks. |
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks (2020.tacl-1)
Copied to clipboard
| Challenge: | Unsupervised pre-training of large neural models has revolutionized Natural Language Processing. |
| Approach: | They propose to use pre-trained checkpoints for Sequence Generation to initialize a Transformer-based sequence-to-sequence model that is compatible with these checkpoint. |
| Outcome: | The proposed model is compatible with pre-trained BERT, GPT-2, and RoBERTa checkpoints and achieves state-of-the-art results on Machine Translation, Text Summarization, Sentence Splitting, and Sentance Fusion. |
LoRaLay: A Multilingual and Multimodal Dataset for Long Range and Layout-Aware Summarization (2023.eacl-main)
Copied to clipboard
| Challenge: | Text Summarization is a popular task and a challenge for neural models. |
| Approach: | They propose to exploit visual/layout information to capture long-range dependencies in summarization models by combining layout-aware and long-reaching models. |
| Outcome: | The proposed datasets cover French, Spanish, Portuguese, and Korean languages. |
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist (2023.acl-long)
Copied to clipboard
| Challenge: | a systematic review of automatic evaluation metrics for Natural Language Generation (NLG) shows that task-agnostic metrics have a weak correlation with human . |
| Approach: | They propose a framework to assess the effectiveness of automatic metrics in three NLG tasks . they propose task-agnostic and human-aligned metrics to be used for evaluation . |
| Outcome: | The proposed framework provides access to the evaluation tools for three NLG tasks. |
Neural Extractive Summarization with Hierarchical Attentive Heterogeneous Graph Network (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing extractive summarization methods focus on balancing salience and redundancy between sentences. |
| Approach: | They propose a hierarchical attentive heterogeneous graph for text summarization that models sentences . they propose to iteratively refine the sentence representations and deliver the labels by message passing . |
| Outcome: | The proposed method outperforms existing extractive summarization methods on large corpus. |
Keeping Notes: Conditional Natural Language Generation with a Scratchpad Encoder (P19-1)
Copied to clipboard
| Challenge: | Qualitative assessments in the form of human judgements (question generation), attention visualization (MT), and sample output (summarization) provide further evidence of the ability of Scratchpad to generate fluent and expressive output. |
| Approach: | They propose to use the encoder as a "scratchpad" memory to keep track of what has been generated and guide future generation. |
| Outcome: | The proposed mechanism improves the fluency of seq2seq models on three well-studied natural language generation tasks. |
Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languages (2026.acl-long)
Copied to clipboard
| Challenge: | Existing metrics have been developed and validated for English and other languages . this narrow focus leaves Indian languages largely overlooked, casting doubt on universality of current evaluation practices. |
| Approach: | They propose a large-scale benchmark that compares 26 automatic metrics with human judgments across six major Indian languages. |
| Outcome: | ITEM evaluates alignment of 26 automatic metrics with human judgments across six languages . authors: outliers exert significant impact on metric-human agreement, improve fidelity . they say the results offer critical guidance for advancing metric design and evaluation in Indian languages - a global market for machine translation and text summarization systems. |